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!.  Intrcdurtiun 


Tli«*  purpose  of  this  letter  is  to  discuss  our  research  into  parallel  systems  software  and  hardware,  and 
parallel  prol>|em  solving,i<u4^trd  under  .A^Foree  Grant  A 2-0303.  Coder  the  eurrent  grunt,  a 
detailed  design  and  partial  implementation  of  a  parallel  problem  solving  system,  PRISM  (  parallel  infer¬ 
ence  .system),  based  on  logic  was  achieved.  The  PRISM  requires  that  the  ZMOB  parallel  processor  be 
available  for  use.  In  addition,  systems  software  and  hardware  have  been  developed.  It  is  estimated  that 
XMOR  will  become  available  for  use  during  the  Fall  of  1(183.  Hence,  a  full  test  and  debugging  of  PRISM 
cannot  be  achieved  under  the  current  grant.. 

§ - “ - J 

At  the  end  of  the  current  grant  we  expect  to  have  accomplished,  as  a  minimum,  all  of  the  objectives 
proposed.  That  is,  in  the  area  of  parallel  problem  solving,  the  initial  PRISM  has  been  fully  designed;  indi¬ 
vidual  programs  have  been  implemented  and  tested  in  a  non-parallel  environment;  and  investigations  have 
been  made  into  extensions  to  the  initial  design^As  a  consequence  of  the  work,  six  papers  were  accepted 
for  publication  in  conference  proceedings,  and  one  technical  note  was  written.  Other  papers  are  in  pro¬ 
gress  and  will  be  completed  before  the  end  of  the  current  grant. 

2.  Accomplishments  on  Efforts  During  Period  June  S0,l9S2-September  15,19SS 

In  section  2.1  we  discuss  work  accomplished  in  parallel  problem  solving,  and  in  section  2.2  we  dis¬ 
cuss  work  in  parallel  systems  software  and  hardware.  We  describe  the  accomplishments  made  as  of  August 
|.r>  and  those  expected  by  the  end  of  the  grant, September  15,  1083 


2  I  7MOD  and  Parallel  Problem  Solving 

During  the.  period  June  30,1982-September  15,1983,  we  proposed  that  three  major  tasks  be  accom¬ 
plished: 

(a)  Design  of  an  Initial  Parallel  I,ogic  Problem  Solver. 

(h)  Implementation  of  the  initial  design. 

(c)  Investigate  extensions  to  the  initial  design. 
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In  the  following  three  sections  we  describe  progress  made  oo  these  efforts.  In  the  fourth  section,  we 
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•J.I  .l  thtign  of  an  Initial  Parallel  Logic  Problem  Solver 

The  functional  specification  of  a  system  termed  PRISM  (Parallel  /nference  .System)  wii  essentially 
completed  before  the  start  of  the  effort.  A  document  termed  "Functional  Specifications  of  the  ZMOD 
Problem  Solver"  was  written  and  completed  during  the  period  of  the  grant  and  provides  the  complete 
funr’ional  specification  of  the  system. 

The  detailed  design  of  the  functional  specification  is  completed.  Some  modifications  may  be  made 
as  the  system  undergoes  implementation. 

!.!.$  Implementation 

The  implementation  of  PRISM  requires  the  availability  of  7.MOB.  The  ZMOD  system  is  not  vet 
fully  available  to  support  the  complete  implementation  of  PfUSM.  A  stand  alone  Z80A  system  that  was 
submitted  for  bids  during  May  1082  has  been  approved  by  the  University  for  purchase  and  delivery  was 
made  in  February  1083. 

Substantial  progress  has  been  made  on  implementation  in  spite  of  the  above  equipment  status.  The 
status  of  the  major  parts  of  the  design  is  as  follows. 

(1)  Vtrr  inhrface  with  VAX' 

The  program  provides  the  interface  between  the  user  and  VAX,  the  host  computer  for  PRISM.  The 
program  has  been  implemented  and  is  tested.  A  full  test  will  require  ZMOD. 

(2)  l-'itenrional  Database  (EDR)  for  Moblrti  The  Extensional  Database  (EDB)  resides  on  moblets.  An 
assembly  language  program  has  been  implemented  and  runs  on  a  single  Z80A.  When  the  entire  rela¬ 
tional  table  resides  on  a  single  moblet,  the  EDB  code  responds  to  queries.  The  program  is  partially 
tested  and  the  code  that  supports  the  distribution  of  the  EDB  on  several  machines  exists.  Testing 
requires  the  availability  of  ZMOB. 

(3)  Erh neional  Databate  for  VAX’ 

The  EDB  is  constructed  by  the  user  in  the  VAX  machine.  The  database  supplied  by  the  user  is 
stored  initially  in  the  VAX.  Syntax  checks  are  performed  on  the  input  data,  and  errors  are  report  d 
to  the  user.  The  data  is  then  indexed,  and  formatted  for  transmission  to  the  appropriate  number  of 
moblets  required.  Implementation  of  this  portion  of  the  system  is  in  progress  and  is  expected  to  be 
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substantially  completed  prior  to  September  15.  1983. 

( I)  /nt in. -tonal  Databasr  I ID1I )  for  ZMOB  and  Monitor 

Tlir  Intentional  Database  (11)11)  stores  the  procedure*  in  the  system.  The  initial  design  does  not  per¬ 
mit  the  number  of  procedures  to  exceed  the  size  of  a  inoblet.  The  IDB  has  been  implemented  in 
Pascal  and  is  being  tested  on  the  VAX.  The  program  has  been  converted  to  C  for  the  moblets. 
Debugging  of  the  code  will  require  ZMOB.  The  IDB  monitor  has  been  implemented  and  is  being 
tested. 

(5)  Intuitional  Database  (IDB)  for  VAX 

As  with  the  EDI),  the  IDB  is  entered  into  the  VAX  by  the  user.  The  program  does  syntax  checks  on 
the  input  data,  coordinates  with  EDO  data  provided  by  the  user,  indexes  the  procedures  and 
prepares  the  programs  and  data  for  transmission  to  the  moblets.  The  program  has  been  imple¬ 
mented  and  tested.  It  has  been  interfaced  with  the  user  interface  program.  It  must  be  tested  in 
conjunction  with  the  ZMOB. 

(0)  Problem  Solving  Machine  (PSM) 

The  Problem  Solving  Machine  is  the  central  portion  of  PRISM.  A  stripped-down  version  of  the 
design  has  been  implemented  in  PROLOG  and  is  running  on  the  VAX.  The  full  PSM  program  has 
been  implemented  in  PROLOG  and  converted  to  C,  so  as  to  improve  efficiency.  The  PROLOG  pro¬ 
gram  will  then  serve  as  a  high  level  operational  and  axiomatic  definition  of  the  PSM.  The  code  has 
to  be  debugged  and  requires  the  availability  of  ZMOB. 

(7)  Communication  Primitives 

The  communication  primitives  have  been  implemented  and  require  ZMOB  for  a  full  test. 

To  further  the  implementation,  a  portion  of  ZMOB  is  simulated  on  the  VAX  and  interfaces  with  the 
existing  programs.  A  primitive  system  consisting  of  the  user-VAX  interface,  the  IDB  programs,  and  the 
stripped-down  version  of  the  PSM.  on  a  simulated  ZMOB  belt,  has  been  tested.  This  has  permitted  us  to 
te-t  several  portions  of  the  system  together  rather  than  in  isolation. 

S.l.S  Investigate  Extensions  to  the  Initial  Design 
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The  primary  emphasis  since  the  award  of  the  current  grant  hat  been  directed  towards  (he  di-ign 
and  implementation  of  PU1SM.  Simultaneously  extensive  investigations  were  made  on  a  number  of  topic- 
as  described  below  We  expect  to  have  some  of  these  efforts  in  an  advanced  stage  of  completion  by  Sep¬ 
tember  1U8.J  and  other*  will  require  substantial  work  during  the  next  year's  proposed  effort. 

(a)  Exit  ntions  to  t he  Problem  Solving  Machine 

Considerable  progress  has  been  made  on  this  subject.  Our  initial  design  has  been  extended  to 
include  a  limited  amount  of  AND-parallclism.  Further  work  will  Le  performed  on  achieving  full 
AND-parallelism. 

Consideration  is  being  given  to  the  control  structure  in  general.  A  theory  of  backtracking  has  been 
developed  for  function-free  problems.  A  technical  report  has  been  written  that  describes  how  one 
can  take  advantage  of  integrity  constraints. 

Work  on  control  structures  will  continue  into  the  next  year's  work. 

(h)  IDU  Extensions 

Work  is  starting  on  the  design  for  the  IDD  which  will  permit  extension  to  procedures  that  exceed  the 
size  of  a  single  moblet. 

(r)  llackend  D  at  abate  Machine »  and  Peripheral  Device » 

A  study  has  started  on  backend  database  machines  to  determine  their  availability.  Once  this  is 
done,  considerations  will  be  given  to  interfacing  with  such  systems.  Considerations  as  to  how  to 
interfare  with  a  relational  database  machine  have  been  given  as  described  in  Section  2.1.1,  below. 

(d)  f  Vi  r  and  System  Conridc ration* 

To  be  an  effective  tool  in  a  research  environment,  additional  features  must  be  added  to  PUISM. 
Preliminary  considerations  are  being  given  to  the  gathering  of  statistics;  providing  the  user  the  abil¬ 
ity  to  view  the  proof  tree  structure  as  it  is  evolving;  and  recovery  in  the  event  of  system  failures. 
Wr  expert  to  have  a  preliminary  functional  specification  of  these  areas  by  September  1983. 

i'./.f  Publication *  and  It  (port* 

As  a  consequence  of  work  performed  on  this  effort,  four  papers  were  accepted  for  publication  in 
refereed  conference  proceedings,  two  papers  appeared  in  an  invited  workshop,  one  ndditional  technical 
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K  jNirt  was  written  rvn<t  one  technical  note. 

I'lie  publications  and  reports  cover  a  number  of  different  topics  :  functional  description  and  detailed 
deign;  PRISM  system  and  alternative  aspects;  control  structures;  and  interfacing  logic  programs  and 
databases. 

(a)  Functional  Description  and  Design 

In  { I)  a  functional  description  is  provided  of  the  PRISM.  The  description  covprs  the  ld)li,  the  IRM. 
the  ll)ll  monitor,  the  user  intetface  and  the  PSM.  A  detailed  description  of  the  design  of  the  Ui|)  is 
provided  in  |J]  These  reports  are  intended  for  internal  use  and  will  not  he  submitted  to  journals. 

|b)  I'll  ISM  Syct,  m 

Aspects  of  the  PRISM  appear  in  a  number  of  papers  and  reports.  In  |l]  we  present  the  initial  ideas 
that  led  to  the  ultimate  design  of  the  system.  The  paper  j!>]  is  a  condensation  and  minor  revision  of 
the  earlier  report.  Aspects  of  the  PRISM  system  are  covered  in  papers  |2|,  |6|,  and  |8).  The  heart  of 
the  PRISM,  the  problem  solving  machine  (PSM)  is  described  in  [6|. 

(c)  Control  Structure > 

A  theory  of  intelligent  forward  and  backward  tracking  is  provided  in  [7).  The  theory  applies  to 
function-free  problems  and  describes  how  lemmas  and  integrity  constraints  may  be  used  during  the 
search  process. 

(d)  Interfacing  Logic  l‘ro  grams  and  Database s 

Various  possible  ways  in  which  a  database  may  be  interfaced  with  logic  programs  are  discussed  in 
( t).  Among  the  options  described  is  the  combining  of  object  language  and  meta-language  state¬ 
ments 

2  ll'urfc  Completed 

The  Zinob  computer  is  composed  of  256  7.80  computers  connected  on  an  intelligent  high-speed  ring 

bus  calb'd  the  "conveyer  belt".  It  has  been  described  extensively  elsewhere.  Each  Z80  has  61k  bytes  of 

WV 

memory,  a  parallel  port,  a  serial  port,  3nd  a  floating  point  chip  in  addition  to  its  conveyer  belt  connec¬ 
tion  Initially  Zmoh  will  he  completely  dependent  on  a  host  computer  for  downloading  of  programs  and 
for  in:iss  storage.  The  Host  will  be  the  Department  of  Computer  Science's  Vax-1 1/780,  or  a  dedicated 


Vast  purchased  under  grants  pending  under  the  DoD  special  equipment  ptngtam  and  the  National  Science 
foundation. 

Individual  ZW*  with  ass'iriated  hardware  are  called  “nmlilets".  A  moblct  consists  of  a  /.Hi)  and  a 
"mailstop’  or  ’mailbox'.  Mailboxes  are  tied  together  on  the  ’belt".  The  mailslops  associat'd  with  host 
ci«m:iiunicalions  are  "V'axstops" 

?  i.’  /  Hardware 

The  7.in»b  basic  design  has  been  checked  in  two-mobfet  versions  both  wire-wrapped  and  on  printed 
eircuit  boards.  Multiple  processors  can  tun  independently,  as  many  as  necessary  (up  to  10  have  been 
tested).  A  serious  glitch  was  found  in  the  processor  card  in  January  1083,  and  since  then  there  have  been 
no  processor  failures. 

Hardware  debugging  has  focused  on  communications  between  the  processors.  The  four  components 
of  the  communication  system— the  master  clock,  the  clock  cables  and  backplane,  the  backplane  intercon¬ 
nect  cables,  and  the  mailstop  boards— have  each  undergone  several  revisions.  The  clock  circuit  is  being 
tuned  to  provide  optimal  timing  between  the  clock  and  index  pulses  to  the  moblets.  Several  versions  of 
clock  cable  are  being  tried,  including  coax,  twisted  pair,  and  shielded  twisted  pair.  The  clock  cables  are 
critical  because  they  must  run  for  several  yards  to  distribute  clock  to  all  the  processors.  Deglitching  capa¬ 
citors  on  the  backplane  have  eliminated  some  noise,  and  pull-up  resistors  on  the  mailstop  hoards  have 
been  adjusted  for  better  noise  tolerance.  A  logic  analyter  has  been  rented  to  better  view  multiple  mail- 
stop  signals. 

Communication  is  reliable  in  one  direction  along  a  single  backplane.  A  complete  communications 
loop  can  be  achieved  for  several  seconds  without  a  failure.  The  problems  are  not  unexpected  and  pri¬ 
marily  involve  noise  and  liming  relations  with  the  master  clock. 

S  Software 

There  are  three  main  projects  looking  with  applications  for  Zmob.  These  are  the  Computer  Vision 
project  with  Professors  ffoscnfehi  and  Davis,  the  Distributed  Numerical  Computation  project  with  Profes¬ 
sors  Stewart  and  O’l.eary,  and  the  Distributed  Problem  Solving  project  with  Professor  Minker.  Path 
plans  to  use  Zinob  to  explore  parallel  processing  algorithms  in  their  specific  domains,  and  each  faces  (he 
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i  ri.lilriii  of  operating  system  support  for  coordinating  the  processes  and  accessing  the  powerful  '/.mob 
hardware 

These  three  projects  need  similar  basic  operating  system  utilities.  The  projerts'  implementation 
strategies  have  been  driven  by  the  Zmob  conveyer  belt  hardware  design  but  none  of  the  projects  envisions 
winking  at  the  machine  rode  level  at  which  the  conveyer  belt  can  be  directly  accessed.  Each  requires 
high-level  language  access  to  the  full  conveyer  belt ‘capability. 

The  system  utilities  for  use  by  all  three  projects  are  under  development.  In  particular,  the  following 
software  has  been  completed  and  is  fully  documented  on-line  the  Computer  Science  Department's  V'ax 
computer: 

1.  c  -  Run  Whitesmiths  C  compiler  for  sSO/smob 

2.  belt  •  primitive  routines  for  imob  mall  stops 

3.  lol  -  IO  library  for  imob. 

4.  ifasl  -  Load  a  imob  program  at  0600  baud 

5.  tgo  -  transfer  a  program  to  the  imob,  and  go 
S.  iload  -  load  the  xmob's  memory 

Software  working  hut  for  which  documentation  is  still  being  readied  includes: 

(1)  Z80  Simulator  This  emulates  the  basic  Z80  processor  without  the  Zmob  environment.  It  was  the  first 

emulator  to  be  completed  and  provided  initial  experience  with  the  Z80  environment.  It  is  a 
sufficiently  detailed  emulation  to  permit  running  CP/M  and  Prolog,  a  capability  much  used  by  the 
distributed  problem-solving  group. 

(-)  Communications  Simulator.  This  emulates  multiprocessing  and  use  of  the  mailstop  and  conveyer 
belt  environment  but  executes  Vax  C  rode  rather  than  Z80  machine  language.  It  performs  multipro- 
ce.  sing  using  basic  Cni.x  capabilities.  The  interface  to  the  conveyer  belt  uses  the  same  high  level 
language  rails  that  will  be  available  on  the  moblets.  Check  out  has  been  via  an  implementation  of  a 
solution  to  the  dining  philosophers  problem. 

(.'I )  Communications  Activity  Display.  This  system  accepts  a  stream  of  input  describing  the  belt 
activity  and  displays  on  a  color  graphics  display  the  resultant  belt  status.  The  input  stream  is  now 
generated  by  the  communications  simulator  (see  above)  and  will  eventually  be  generated  by  the 
'monitor  mail  stop'  on  the  actual  Zmob  (see  below). 
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(!)  SyMern  Debugging  Harness  Tins  permits  debugging  new  low  level  system  software  for  inclusion  in 
/.limit.  It  allows  the  tester  to  manually  create  conditions  winch  in  actual  practice  would  he  unite 
ra.c,  thus  testing  the  robustness  of  the  system.  It  consists  of  three  parts:  (a)  the  system  software 
under  test,  (b)  the  mohlet  simulation  system,  and  (e)  the  user  interfaee  display  connected  to  both  (a) 
and  (b).  The  system  software  under  test  believes  that  it  is  running  within  a  rnoblet,  as  emulated  by 
the  rnoblet  simulation  system.  In  fact,  however,  all  attempts  at  communication  are  simply 
displayed  to  the  user  via  (c).  The  user  can  then  specify  any  arbitrary  response  on  the  part  of  the 
hardware,  including  timing  relationships.  The  right  half  of  the  user's  display  is  reserved  for  interac¬ 
tion  about  attempts  at  rnoblet  communication.  The  left  half  of  the  display  can  be  used  by  the  sys¬ 
tem  under  test  to  display  internal  status  of  interest  to  the  user. 

(.*,)  Multiple-window  Communications  Interface.  This  is  an  adaptation  of  the  maryland  window  shell  to 
problems  of  communications  with  the  Zmob.  The  window  shell  allows  arbitrarily  sized  and  posi¬ 
tioned  rectangular  windows  on  a  single  CRT  screen,  each  functionally  equivalent  to  an  independent 
terminal.  A  typical  application  is  to  open  several  windows  and  run  a  communication  process  to  a 
different  rnoblet  in  each  window. 
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